NESSUS Hybrid AMV+ - Importance Sampling

NESSUS Advanced Mean Value with Iterations (AMV+) [1]

NESSUS Advanced Mean Value with Iterations (AMV+) is a most probable point (MPP) based analytical method. It provides a significant improvement over MV, where first it uses approximation to estimate MPP and then performs additional iterations when locating the MPP in order to obtain a more accurate result. A new Taylor series approximation is used for each new MPP and the process is repeated until method converges on an MPP (i.e. no significant change in MPP over a few iterations) or 10 iterations are completed. AMV+ uses finite difference approximations to estimate the gradients. The step size can be set using the Finite Difference Step Size option available but care should be taken for non normal variables that the finite difference step does not move outside of the feasible range of the variable. The method does not support non-smooth responses and failed runs as it is a gradient based method. This method generally requires less than a couple hundred evaluations to compute a probability for less than 10 design variables. AMV+ should always be preferred to MV method. This method should not be used with discrete design variables or discrete response variables. Multiple local MPPs may induce error in the probability estimation by this method and that error tends to be most pronounced for large probabilities of failure.

Advanced Mean Value (AMV) improves the mean value method by using a correction for errors introduced from the truncation of a Taylor's series. The AMV model is defined as:

where H(ZMV) is defined as the difference between the values of ZMV and Z calculated at the Most Probable Point Locus (MPPL) of ZMV. The MPPL is defined by connecting all the MPP's for different z values. The MPPL of ZMV is generally nonlinear curve in the u-space. The key to the AMV method is the reduction of the truncation error by replacing higher-order terms H(X) by a simplified function H(ZMV) dependent on ZMV. Ideally H(ZMV) function should be based on the exact MPPL of the Z-function but AMV simplifies the procedure by using MPPL of ZMV. Thus optimization of truncation error is not optimum.

Analyzer does not provide AMV but it provides an even better method AMV+. This is an improvement over AMV by using an improved expansion point, which is done by an iteration procedure. Based initially on ZMV and by keeping track of the MPPL, the exact MPP for a limit state Z = z can be computed to establish the AMV+ model defined as: 

where x* is the converged MPP for Z = z. The variables X are generally non-normal and dependent, thus AMV+ model which is linear is in X-space. The above equation provides an initial estimate of the curvature (about the MPP) in the u-space that can be used for approximate probability of failure analysis. The steps followed by AMV+ could be summarized as follows:

  • Construct mean based response function based on the mean values of the design variables and use it as initial guess for MPP
  • Use the AMV approximation to come up with a better MPP.
  • Perform a curve fit operation and then we will have a new MPP
  • The above steps are performed until the MPP converges or 10 iterations are completed.

Special caution should be used when using probability values in cases where the method has not been able to converge on an MPP. In such cases some experimentation can be carried on to vary the Finite Difference Step Size option.

Importance Sampling

Importance sampling methods seek to improve the efficiency of probability estimates by focusing the samples in the important region of the design space, where failure is more likely to occur. Particularly for small probabilities of failure, basic Monte Carlo sampling can require a very large number of samples, because the vast majority of the samples will lie in the safe region. Importance Sampling concentrates the sampling points in the region of most importance. Importance Sampling can be orders of magnitude efficient than Monte Carlo.

CENTAUR provides two importance sampling methods, which are based on the concept of shifting the importance density to the Most Probable Point (MPP) of failure. These are the basic Importance Sampling (IS) method, and the Multimodal Adaptive Importance Sampling (MAIS) method.

The basic importance sampling method defines a new importance density . The probability of failure is then estimated by:

where I(x) is the indicator function, which is equal to 0 for safe points and 1 for failed points, and is the original PDF of the inputs.

Many different choices of the importance density, , have been proposed. The CENTAUR IS method defines the importance density by shifting the mean of the inputs to the MPP, while the input variances are not changed. This is illustrated in Figure 1, which shows a comparison of basic Monte Carlo sampling and MPP-centered importance sampling for a simple limit state with two random variables. Before collecting the importance samples, the MPP must first be determined, which is done using either the Advanced Mean Value or First Order Reliability Method.

Figure 1. Comparison of basic Monte Carlo and MPP-based Importance Sampling.

 

The variance and coefficient of variation (COV) of the importance sampling probability estimator can be estimated by computing the sample variance of the summand. This provides the following estimate of the sampling variance:

and the COV is by definition:

Notice that the COV is a function the failure probability, the sample size, and the importance density. The COV can be used as an error estimate or as a convergence criterion to determine the number of samples necessary to achieve a given error requirement. By approximating the sampling distribution as a normal distribution, approximate error bounds can be obtained on the true failure probability. For example, at the 95% confidence level, the confidence interval for pf is:

Control Parameters

Name Default Value Description
Samples 50 This option sets the number of samples to be used in each iteration in the importance sampling.
MaxSamples 1000 This option sets the maximum number of samples in the importance sampling. This does not include the number of evaluations needed to locate the MPP.
Convergence Tolerance 0.05 Coefficient of Variation is used as a convergence tolerance. Coefficient of variation is the ratio of standard deviation of probability of failure to that of probability of failure (in this case estimated probability of failure). The smaller the value of coefficient of variation, more accurate is the estimate of probability. This option can take value between 0 and 1 and is advisable to have a value between 0.01 and 0.2.
Finite Difference Step Size 0.01

This option is used to calculate finite difference step size. The step sizes are determined based on the value of this option multiplied by the mean value of the design variable. Thus if the mean value of the design variable was 5 and the finite difference step size option had the value of 0.1, the actual step size would be 0.1*5 = 0.5. The step size is used by the underlying optimizer trying to locate the MPP. The option expects a value typically within 0 and 1.

Seed N/A The seed sets the starting point for the random number generator used with importance sampling. If running multiple tests, keep this value the same if all else is constant. If left blank, Analyzer will generate its own.

References:

1. NESSUS Theoretical Manual, February 17, 2012, Section 3